(19) 



(12) 



Europaisches Patentamt 
European Patent Office 
Office europeeh dee brevets 




(43) Date of publication: 

20,05.199* Bulletin 1998/21 



■III 

(ii) EP 0 843 482 A2 

EUROPEAN PATENT APPLICATION 

(51) mta* H04N7/24 



(21) Application number 07309079.8 

(22) Date of filing: 12.11.1997 



(84) Designated Contracting States: 

AT BE CH DE DK ESRFRGB GR IEITULU MC 
NL PTSE 

Designated Extension States: 
ALLTLVMK RO SI 

(30) Priority: 15.11.1996 JP 304401/96 

(71) Applicant SONY CORPORATION 
Tokyo 141 (JP) 



(72) Inventors: 

• Horiguchl, Marl, Sony Corporation 
Shinagawa-ku, Tokyo 141 (JP) 

• Komuro, Teruyoshl, Sony Corporation 
Shinagawa-ku, Tokyo 141 (JP) 

(74) Representative: Pilch, Adam John Michael et al 
D. YOUNG & CO., 
21 New Fetter Lane 
London EC4A 1 DA (GB) 



(54) Receiving devices and methods 



(57) Inordertoplay back a plurality of kinds of image 
data using a single device, a 1 394 receiver (1 1 ) receives 
data transmitted via an AV bus according to a format of 
an IEEE 1394 standard. A separating circuit (12) then 
determines the format of this data by referring to a pre- 
scribed region of a CIP headsr ot this dataL When this 



data is MPEG-PS data, it is outputted to an MPEG-PS 
decoder (1 3). When this data is MPEG-TS data, it is out- 
putted to an MPEG-TS decoder (14). When this data is 
DVCR SD data, ft is outputted to a DVCR-SD decoder 
(15). The MPEG-PS decoder (13), MPEG-TS decoder 
(14) and the DVCR-SD decoder (15) then decode the 
supplied data of the respective formats. 
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Description 

The present invention relates to receiving devices 
and methods for decoding received data at any of a plu- . 
ralfty of decoders In accordance with a format of the re- 5 
cefved data. 

In recent years, DVD (Digital Versatile Disc) -Video 
has been standardized, so that it is expected to become 
widespread. With the DVDs, video data is compressed 
using an MPEG (Moving Picture Experts Group) - PS to 
(Program Stream) method and recorded. A DVD player 
plays back a DVD at a driving unit, with MPEG-PS data 
played back from the DVD being decoded at a decoder 
and outputted to a television. An image corresponding 
to this data is then displayed. ?S 

On the other hand, digital satellite broadcasts are 
also becoming Widespread. Video data transmitted by 
these digital satellite broadcasts is compressed using 
an MPEG-TS (Transport Stream). A receiver for receiv- 
ing the digital satelfte broadcasts then has a built-in de- 20 
coder for decoding MPEG-TS data. 

However, as described above, when a number of 
images such as digital satellite broadcast images orlm- 
ages from digital video cassette recorders (D VCR) etc. 
are to be enjoyed in addition to the images played back 2S 
by the DVD player, because of the image data formats 
being different in correspondence to these images, mu- 
tually independent playback systems have to be provid- 
ed in order to play back all of the image data. This there- 
fore causes the device to be large in size. so 

According to one aspect of the present Invention, a 
receiving device for receiving data encoded In a pre- 
scribed data format from a plurality of transmitting de- 
vices via a digital interface, and decoding the data in 
accordance with the prescribed data format, comprises 3S 
a receiver, a first decoder, a second decoder and a sup- 
plying unit The receiver '« for receiving at least data of 
the first and second formats. The first decoder is for de- 
coding the data of the first format. The second decoder 
is for decoding the data of the second format The sup- *o 
plying unit is for supplying data received by the receiver 
to either of the first and second decoders in accordance 
with a format of the data. 

In this receiving device, the data can be included 
within a packet and the supplying unit supplies data re- 43 
carved by the receiver to either of the first and second 
decoders in accordance with a value corresponding to 
a format of the data written to a preserved region of the 
packet 

The prescribed region can be a common rso- 50 
chronous packet (CIP) header of an isochronous pack- 
et. 

The dtgftal interface can be a digital interface con- 
forming to an Institute of Electrical and Electronics En- 
gineers (IEEE) 1394 standard. 55 

The receiver can receive packets having data of 
whichever of the first and second formats transmitted in 
isochronous communications of the Institute of Electri- 



cal arid Electronics Engineers 1394 standard. 

The receiving device can further comprise a multi- 
plexer to which data outputted from the first and second 
decoders are inputted and a display circuit for displaying 
output data from the multiplexer The receiver receives 
the data of the first and second formats in parallel in the 
isochronous communications and the display circuit dis- 
plays a plurality of images corresponding to each of the 
data simultaneously In a single picture in real time. 

The receiver of this receiving device can also be 
made to be capable of receiving data of the third format, 
and further comprise the third decoder for decoding the 
data of the third format 

Further, the first second and third formats can be 
a program stream format, of Moving Picture Experts 
Group (MPEG) system, a transport stream format of 
MPEG system and a standard definition (SO) format of 
digital video cassette recorder, respectively. 

Moreover, the first and second decoders can each 
comprise a storage means having a storage capacity of 
at least 1 .2 megabytes for temporarily storing data when 
decoding. 

According to another aspect of the present inven- 
tion, a receiving method for receiving data encoded in 
a presented data format from a plurality of transmitting 
devices via a digital interface and decoding the data in 
accordance with the presented data format comprises 
the steps of receiving at least data of first and second 
formats, supplying the received data to either of first and 
second decoders in accordance with a format of the da- 
ta, and decoding the received data at either of the first 
and second decoders. 

in this receiving method, the data can be included 
within a packet and the received data is then supplied 
to either of the first and second decoders in accordance 
with a value corresponding to a format of the data written 
to a prescribed region of the packet 

The prescribed region can be a common iso- 
chronous packet (CIP) header of an isochronous pack- 
et 

The digital interface can be a digital interface con- 
forming to an Institute of Electrical and Electronics En- 
gineers 1394 standard. 

The received packets can be packets having data 
of whichever of the first and second formats transmitted 
in isochronous communications of the instflute of Elec- 
trical and Electronics Engineers 1394 standard. 

Further, wfth this receiving method, each of data 
outputted from the first and second decoders can be 
multiplexed and the multiplexed output data can be dis- 
played, the data of the first and second formats can be 
received in parallel in the isochronous communications, 
and a plurality of images each corresponding to each of 
the data can be displayed simultaneously in a single pic- 
ture in real time. 

Thus a preferred embodiment of the present inven- 
tion enables playback of data of different data format 
images using a single device by connecting a plurality 
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of devices handfing these various kinds of image data 
via a digital interface to a device having a plurality of 
decoders for decoding the image data 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 



FIG. 1 is a block diagram showing an example of a 
configuration for an AV system; 
FIG. 2 is a block diagram showing an example of a 
configuration of a dig ftal TV to which a receh/ing de- 
vice according to an embodiment of the present in- 
vention is applied; 

FIG. 3 is a view showing a structure of an asynchro- 
nous communication packet; 
FIG. 4 is a view showing a format of a CIP header 
of the packet of FIG. 3; and 
FIG. 5 is a view showing ah example of a display 
for an image synthesized from a plurality of images. 

FIGURE 1 shows ah example of a configuration of 
an AV system. In this AV system, a digital televisfon (dig- 
ital TV) 1 to which the receiving device embodying the 
present invention is applied is connected to an AV bus 
6. A built-in 1394 receiver 11 then receives MPEG-PS 
data, MPEG-TS data and DVCR SD (Standard Defini- 
tion) data supplied via the AV bus 6. This data is decod- 
ed at built-in decoders so that a decoded image is dis- 
played. 

A DVD player 2 reads out MPEG-PS data recorded 
on a DVD and outputs this data to the digital TV 1 via 
the AV bus 6 with the data being un-decoded. 

A personal computer 3 carries out various process- 
ings using software and carries out playback of DVD 
ROMs etc., in addition to DVD-Video using a built-in 
DVD drive 21 so that image data such as MPEG-PS da- 
ta, MPEG-TS data and SD data for DVCR etc., are out- 
putted to the digital TV 1 via the AV bus 6. 

A DVCR 4 records or plays back image data to or 
from video cassette tape and outputs DVCR SD data 
read out from the video cassette tape to the digital TV 
1 via the AV bus 6. 

A Set-Top Box (STB) 5 receives broadcast signals 
transmitted from man-made satellites for predetermined 
digital satellite broadcasts via an antenna 41 and out- 
puts image data (MPEG-TS data) for, for example, pro- 
grams selected by a user, to the digital TV 1 via the AV 
bus 6. 

The AV bus 6 is a bus which conforms to the IEEE 
(The Institute of Electrical and Electronics Engineers) 
13g4, High Performance Serial Bus Standard (IEEE 
1 394 standard). 

FIGU RE 2 shows an example of configuration of the 
digital TV 1 . 

At the digital TV 1. the 1394 receiver 11 receives 
data (packets) transmitted via the AV bus 6 according 
to a format of ah IEEE 1394 standard and outputs the 



received data to a separating circuit 1 2 (supplying unit). 

The separating circuit 12 determines the format of 
this data by referring to a prescribed region (to be de- 
scribed later) of a CIP (Common Isochronous Packet) 
& header of the received data and then outputs this data 
to the decoder corresponding to this format 

Namely, the separating circuit 12 outputs this data 
to an MPEG-PS decoder 1 3 (the first decoder) When the 
supplied data is MPEG-PS data. When the supplied da- 
io ta is MPEG-TS data, the separating circuit 12 outputs 
this data to ah MPEG-TS decoder 14 (the second de- 
coder). When the supplied data is DVCR SD data, this 
data is outputted to a DVCR SD decoder 15 (the third 
defcoder); 

The MPEG-TS decoder 14 decodes euppDed 
MPEG-TS data, outputs a generated digital video signal 
to a synthesis circuit 16 and a multiplexer 17-1 , and out- 
puts a generated digital audio signal to a multiplexer 
17-2. 

20 The MPEG-TS decoder 14 has a built-in memory 
51 having a storage capacity of at least 1 .2 megabytes, 
this memory 51 is used as a video transport buffer and 
a decoder buffer conforming to MPEG standards. 
The video transport buffer Is a buffer of a total of 
& 234.5 kilobytes, with a 0.5 kilobyte transport buffer (TB: 
Transport Buffer), 10 kilobyte main buffer (MB: Main 
Buffer) and a 224 kilobyte elementary stream buffer (EB: 
Elementary Stream Buffer). 

The transport buffer of these buffers is used when 
30 a header of a packet for the MPEG-TS data is removed. 
The main buffer is provided to slow down the rate 
of the data transfer to the elementary stream buffer The 
rate of transfer from the transport buffer to the main buff- 
er is set to be the rate at the time of multiplexing (for 
3B example, 1B Mbpe) but the rate df the data transfer from 
the main buffer to the elementary stream buffer is set to 
be a lower rate (for example, 15 Mbps). 

The elementary stream buffer stores the contents 
of the elementary stream until the arrival of the time cor- 
40 responding to time stamps PTS (Presentation Time 
Stamp) and DTS (Decoding Time Stamp) included in the 
MPEG data. At the arrival of the time, data for one ac- 
cess unit is outputted to a built-in decoder (not shown 
in the drawings) in the MPEG-TS decoder 14. Data out-. 
** . putted from the elementary stream buffer is then decod- 
ed by this decoder. 

When carrying out decoding using the MPEG for- 
mat, the decoder buffer holds the frnage (picture) to be 
decoded and a picture for comparing (j picture, P picture 
so etc.). A storage capacity for at least two pictures (an I 
picture and a P picture) is therefore required at the de- 
coder buffer. 

When the image signal is of the NTSC format, one 
picture comprises 720 x 480 pixels. As the ratio of a lu- 
55 minance signal Y and two color difference signals Cb 
and Cr Is then 4:2:0, the storage capacity required per 
one picture is approximately 0.5 Megabytes (=720x480 
x (4+2+0)/4). Therefore, in this case, a storage capacity 
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of approximately 1 .0 Megabytes is required for the de- 
coder buffer for two pictures. 

On the other hand, when the image signal is in the 
PAL format, one picture comprises 720 x 576 pixels and 
the ratio of the luminance signal Y and the two color dif- 
ference signals Cb and Cr is 4:2:0. The storage capacity 
required per one picture is therefore approximately 0.6 
Megabytes (=720 x 576 x (4+2+0)/4). therefore, in this 
case, a storage capacity of approximately 1.2 Mega- 
bytes is required for the decoder buffer for two pictures. 

A storage capacity of at least \JL megabytes f=* 1.0 
Megabytes + 234.5 megabytes) is therefore required for 
the memory 51. 

The MPEG-PS decoder 13 decodes supplied 
MPEG-PS data, outputs a generated digital video signal 
to the synthesis circuit 16 and the multiplexer 17-1, and 
outputs generated digital audio data to the multiplexer 
17-2. 

The MPEG-PS decoder 13 has a built-in memory 
41 having a storage capacity of at least 1.2 Megabytes. 
This memory 41 is used as the aforementioned maid 
buffer, the elementary stream buffer and the decoder 
buffer. A storage capacity of 8 kilobytes is sufficient for. 
the main buffer in the MPEG-PS decoder 13. 

The DVCR-SD decoder 15 decodes supplied 
DVCR SD data, outputs a generated digital video signal 
to the synthesis circuit 16 and the multiplexer 17-1 , and 
outputs generated digital audio data to the multiplexer 
17-2. 

The synthesis circuit 1 6 performs synthesis for dig- 
ital signals supplied by the MPEG-PS decoder 13, 
MPEG-TS decoder 14 and DVCR-SD decoder 15 in 
such a manner that, for example, three images are dis- 
played in a single picture, with the synthesized digital 
video signal then being outputted to the multiplexer 
17-1. 

For example, when one image of the three images 
is taken to be a main image and another image is taken 
to be a sub-image for generating an image where the 
sub-image is set Into the main image, the circuit dis- 
closed in, for example, U.S. Pat No. 4,746,983 can be 
utilized as the synthesis circuit 1 6. 

When three images are then arranged so as to be 
displayed as one picture, the circuit disclosed in, for ex- 
ample, Unexamined Published Japanese Patent Appli- 
cation No. 56-136089 can be utilized as the synthesis 
circuit 1 6. 

In addition, when synthesizing a character string 
such as the name of the device that outputted the Image 
data, the circuit disclosed in Unexamined Published 
Japanese Patent Application No. 61-1 94962 can be uti- 
lized as the synthesis circuit 16. 

The multiplexer 17-1 outputs any one of the digital 
signals supplied from the MPEG-PS decoder 13, 
MPEG-TS decoder 1 4, DVCR-SD decoder 1 5 and syn- 
thesis circuit 16 to a display circuit 16 in response to a 
control signal supplied from a control circuit 22. 

The multiplexer 17-2 outputs any one of the digital 



audio signals supplied from the MPEG-PS decoder 13, 
MPEG-TS decoder 14 and DVCR-SD decoder 15 to a 
D/A converter 20 in response to a control signal supplied 
by the control circuft 22. 
s The display circuit 16 displays an image corre- 
sponding to a supplied digital video signal on a CRT 1 9. 

The D/A converter 20 converts the supplied digital 
audio signal to an analog aucflo signal and outputs 
sound corresponding to this signal at a speaker 21. 

The control circuit 22 receives signals correspond- 
ing to user operations from an input un* 23 and outputs 
prescribed control signals corresponding to these sig- 
nals to the multiplexer 17-1 , the multiplexer 17*2 and the 
synthesis circuit 16. 

Next, the operation of the digital TV 1 will be de- 
scribed. 

First, the 1394 receiver 11 of the digital TV 1 re- 
ceives packets transmitted with asynchronous commu- 
nications and data (data fields) included fin the received 
packets is outputted to the separating circuft 1 2. 

FIGURE 3 shows the configuration of packets for 
asynchronous communication. Asynchronous commu- 
nications packets comprise a packet header, a header 
CRC, a data field and a data CRC. 

The packet header further comprises "Datajength" 
expressing the length of the data. Tag* expressing the 
kinds of data format transmuted by this packet, "Chan- 
nel" expressing the channel number of this packet (one 
of 0 to 63), "tcode" expressing the processing code and 
synchronization code "Sy" specified in each application. 
Header CRC (Header_CRC) Is packet header error de- 
tection code and data CRC (Data_CRC) Is data field 
(Data field) error detection code. A data field comprises 
a CIP header and reed time data of which the real time 
data is the original data that Is transmitted. 

FIGURE 4 shows a CIP header format. The OP 
header comprises a send node number SID, a packstihg 
unit DBS, a dividing number FN for data in packetfog, a 
quadlet number QPC (one quadiet is four bytes) added 
to fit data lengths to a prescribed fixed data length at the 
time of dividing, a source packet header flag SPH, a 
counter DBC for detecting missing of packets, a signal 
format FMT and a formal dependent field FDF. Here, rsv 
is a reserved region. 

Next, the separating circuit 12 refers to the value of 
the FMT region of tie CIP header of the supplied data 
and determines which of MPEG-PS data, MPEG-TS da- 
ta and DVCR SD data the supplied data Is in accordance 
with this value. 

When the separating circuit 12 determines that die 
data is MPEG-PS data, this data is outputted to the 
MPEG-PS decoder 1 3. When the data is determined to 
be MPEG-TS data, this data is outputted to the MPEG- 
TS decoder 14. When the data is determined to be 
DVCR-SD data, this data is outputtsd to the DVCR-SD 
decoder 15. 

When this data is supplied, this data is then decod- 
ed by one of the MPEG-PS decoder 1 3, MPEGrTS de- 
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coder 1 4 or the DVCR-SD decoder 1 5, With a generated 
digital video signal then being outputted to the synthesis 
circuit 1 6 and the multiplexer 1 7-1 and a generated dig- 
ital audio signal being outputted to the multiplexer 1 7-2. 

The synthesis circuit 1 6 then synthesizes the digital 
video signals with a pattern designated by the control 
circuit 22 so that images corresponding to digital video 
signals supplied by the MPEG-PS decoder 13, MPEG- 
TS decoder 1 4 and DVCR-SD deccd&r 1 5 are displayed 
on one picture, with the synthesized digital video signal 
then being outputted to the multiplexer 17-1. 

FIGURE 5 shows an example of displaying a syn- 
thesized image. In the example of the display of FIG. 5, 
the image corresponding to the SD data of the DVCRis 
displayed at a region to the upper left of the picture as 
the image from the DVCR 4, the Image corresponding 
to the MPEG-TS data is displayed at a region to the up- 
per right of the picture as the image from the STB 5 and 
the image corresponding to the MPEG-PS data is dis- 
played at a region to the lower left of the picture as the 
image from the DVD player 2. 

The name of the device supplying each image 
( P DVCR\ 'STB* and 'DVD player" of FIG. 5) is displayed 
at the lower side of each region at which each image is 
displayed. 

In this embodiment data of differing formats is re- 
ceived in asynchronous communications in parallel by 
the 1394 receiver 11. A plurality of images respectively 
corresponding to these data can therefore be displayed 
simultaneously on one picture in real time. 

Next, of the supplied digital video signals, the mul- 
tiplexer 17-1 outputs digital video signals designated by 
the control circuit 22 (Le. selected as a result of user 
operations of the input part 23) to the display circuit 18. 
The display circuit 1 B then displays images correspond- 
ing to the supplied video signals on the CRT 1 9. 

On the other hand, of the supplied digital audio sig- 
nals, the multiplexer 17-2 outputs digital audio signals 
designated by the control circuit 22 to the D/A converter 
20. The D/A converter 20 then converts these digital au- 
dio signals into analog audio signals, with sound corre- 
sponding to these analog audio signals being outputted 
at the speaker 21. 

In the above way, the digital TV 1 receives data of 
each format via the AV bus 6, decodes this data using 
a decoder corresponding to the format of this data and 
plays back images and sound. 

In the AV system of FIG. 1, only one digital TV 1 is 
connected to the AV bus 6, but other digital TVs 1 can 
be connected to the AV bus 6 t with data of a plurality of 
formats then being decoded in the same manner. 

As described above, data of the first to third formats 
is received via a digital interface conforming to IEEE 
1 394 standards and the received data is supplied to any 
of the first to third decoders in accordance with the for- 
mats of the data. The data can then be decoded at any 
of the first to third decoders. It is therefore possible to 
play back a plurality of kinds of image data using a single 



device and the scale of the device can therefore be re- 
duced. 



5 . Claims 

1. A receiving device for receiving data encoded in a 
prescribed data format from a plurality of transmit- 
ting devices via a digital interface and decoding said 
to data in accordance with said prescribed data for- 
mat, comprising: 

a receiver for receiving at least data of first and 
second formats; 

5 a first decoder for decoding said data of first for- 

mat; 

a second decoder for decoding said data of 
second format; and 

a supplying unit for supplying data received by 
o said receiver to either of said first and second 

decoders in accordance with a format of said 
data. 

2. The receiving device of claim 1 , wherein said data 
s is included within a packet and said supplying unit 

supplies data received by said receiver to either of 
said first and second decoders in accordance with 
a value corresponding to a format of said data writ- 
ten to a prescribed region of said packet 

30 

3. The receiving device of claim 2, wherein said pre- 
scribed region is a common isochronous packet 
header of an isochronous packet. 

3S 4. The receiving device of claim 1 , wherein said digital 
interface is a digital interface conforming to an In- 
stitute of Electrical and Electronics Engineers 1394 
standard. 

40 5. The receiving device of claim 1, wherein said re- 
ceiver receives packets having data of whichever 
of said first and second formats transmitted in iso- 
chronous communications of said Institute of Elec- 
trical and Electronics Engineers 1 394 standard. 

45 

EL the receiving device of claim 5 further comprising: 

a multiplexer to which data outputted from said 
first and second decoders are inputted; and 
60 a display circuit for displaying output data from 

said multiplexer, 

said receiver receiving said data of first and 
second formats in paraDei in said isochronous 
communications, and 

said display circuit displaying a plurality of im- 
ages corresponding to each of said data simul- 
taneously in a single picture in real time. 
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7. The receiving device of cfeirn 1, wherein said re- 
ceiver is made to be capable of receiving data of 
third format and further, comprises a third decoder 
for decoding said data of third format 

5 

8. The receiving device of claim 1, wherein said first 
format Is a program stream format of Moving Picture 
Experts Group system. 

ft. The receiving device of claim 1, wherein said sec- io 
ond format is a transport stream format of Moving 
Picture Experts Group system 

10. The receiving device of claim 7, wherein said third 
format is a standard definition format of digital video r* 
cassette recorder. 

11. The receiving device of claim 8, wherein said first 
decoder comprises a storage for temporarily storing 
data when decoding, said storage having a storage 20 
capacity of tit least 1 ,2 megabytes. 

12. The receiving device of claim 9, wherein said sec-' 
. ond decoder comprises a storage for temporarily 

storing data when decoding, said storage having a 2S 
storage capacity of at least 1.2 megabytes. 

1 3. A receiving method for receiving data encoded in a 
preserved data format from a piuraBty of transmit- 
ting devices via a digital interface and decoding sard so 
data in accordance with said prescribed data for- 
mat comprising the steps of: 

receiving at least data of first and second for- 
mats; 3S 
supplying received data to either of first arid 
second decoders in accordance with a format 
of said data; and 

decoolng said data at either of said first and 
second decoders. 40 



having data of whichever of said first and second 
formats are received, said data being transmuted in 
isochronous communications of said Institute of 
Electrical and Electronics Engineers 1394 stand- 
ard. 

18. The receiving method of claim 17, wherein each of 
data outputted from said first and second decoders 
is multiplexed and multiplexed output data is dis- 
played, 

said data of first and second formats are re- 
ceived in parallel in said isochronous commu- 
nications, and 

a pfuralfty of images each corresponding to 
each of said data are displayed simultaneously 
in a single picture fan real time. 



1 4* The receiving method of claim 1 3, wherein said data 
is included within a packet and said received data 
Is supplied to either of said first and second decod- 
ers in accordance with a value corresponding to a 43 
format of said data written to a prescribed region of 
said packet 

16. The receiving method of darn 14, wherein said pre- 
scribed region is a common isochronous packet BO 
header of an isochronous packet 

16. The receiving method of claim 1 3, wherein said dig- 
ital interface is a digital interface conforming to an 
Institute of Electrical and Electronics Engineers 55 
1394 standard. 



1 7. The receiving method of claim 1 3, wherein packets 
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